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ABSTRACT" . . 

• "Sew ways of using factor analysis in research designs 
are suggested in this paper that would allow research to move in new 
directions that are being; sugge^sted for educational technology. 'A 
brief simplified overview of factor-analytic technique^ is given, 
followed by a description of some recent developments in 1 




examined. Finally, several studies are usefl to illustrate; the' various 
variations of factor analysis, ^nd to sho^ow the techniques can tap 
into structural as well as perf ormance-bas^ asp.ects of cognition, 
(HAB) 
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At a time wken research methodology is being critically questioned 
(Snow, 1974; Clark and Snow, 1975), it is apl?ropriate to^ loo^c around us 
at research designs and statistical techniques which ar.e untried, unusual, 
new, or which have been tried gnd' abandoned. Admittedly, factor analysis 
as it is generally used does not really fit into any of these categories. 
However, in the following pages ways of using it are suggested which 
are all of these four things. The studies cited as illustrations of the 
methods presented apj^ly factor analysis in new'and unusual ways, and also 
resurrect and elaborate upon methods which have not been used for the 
last ten years. In this way, factor analysis a.llows research to move in 
the new directions that are being^suggested for educational technology. 

* « 

There is no doubt that factor analysis is a com^icated, statistical 
procedure. It has a tendency to Brighten people off, ahd the small group 
of superspecialists in the arfea-4nds , by virtue of the complexity o^f 
thejj: mathematics and their ^reliance on computers, to be beyond the 
reach of the general researcher (Nunnally, 1975). This paper therefore 
begins with .a brief simplif'ied^verview for those not too familiar with 
factor-analytic techniques. Those\ore familiar with the various 
procedures discussed, and my "superspidalists" who come across this 
p^per will, L hope," forgive any oversimplification. But it is hoped 
that those with only a stfp'irf icial knowledge of factor analysis will 
nonetheless be able to get some ideas of how it can be applied profitably 
to research. ^3'ext, some recent 'developments in factor - analytifc 
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techniques are discussed, whi^h make it more useful to the researcher. 
Then certain trends in instructional technology research which seem to 
reqjiire multivariate statist^ical techniquea^^re examined.' These' are 



linked to the noU^on of cognitive structy^re-^tsel^, becoming grist to 
the researcher's mill. Finally, several studies are used to illustrate . 
the various variations of factor analysis, and ta show how the technique 
can tap into structural as well as performance-based aspects of cognition. 

Factor analysis: -^n overview 

Factor analysis is a method of simplifying matrices af intercor- 
relations among sets of variables. To do this, the techn*que^^^efltif ies 
clusters of variables tha^ are highly correlated among themselves, and 
'uses these to describe more fundamentalT variables dimensions, in 
t4^e domain from which the original variables were taken. These fundamental 
variables are called factors. Not only does >^ctor analysis identify' 
basic factors in a set of intercorrelated variables, but it also 
calculates the strength of the relationship between each variable and 
each factor. This measure is the variable's "loading" dn the factor, and 
functions in a way similar to a correlation coefficient. - 

' The variables in the' original intercorrelation matrix can be any 
variables for which cor^lation coefficients, covariances or other measures 
of association can' be calculated. Historically, these variables have _ ^ 
usually been tests witliin test batteries, and factor analysis of the 
mtercorrelations among the tes'ts has been used to search for and 

. ' . ~ • .../3 
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identify various dimensions within human intcl I icence , whieLher a single 
^ general intelligence factor (Sircar:nau, 190A)>, u;ore complex hierarchical 
arrangements oT human intellectual abilities (LUirt, 19A8; Vernon, 1961), 
or a complete model of the structure of the human intellect. (Guilford, 1956; 
^Guilford, 1967). Its use iTby no means limited to this* area, however, 
Jactor analysis has been used to. describe the structure of associative 
meaning within a set ^f interrelated words (Decse, 1962, 1965), to • 
study basic dimens/ons underlying the phenomcuon^of aphasia (Jones and 
V/epman, 1961), ^d even to identify -certain basic -chemical phenomena 
assoViated with the hardening of cement (Woods, Steinour and Starke, 1932). 

A useful way of looking at tactofs is Co Chink of Chcm as vecCors 

'in a "dof ined space. (More commonly, Chis id&a is applied to correlation 

between two variables, when a correlation coefficient is described as 

the cosine of the ancle between two lines representitig the strength and 

the direction of each vnriable.) In the case of factotf analysis, the 

^ / » 

factors: , as vectors, can be moved about an axite throuf^ the Sp^ce in 

/ ' 

which tlicy lie, and can thus be moved from their original location to a 

<<* 

position v/hich provides a more parsimonious descriptiop of the 
relationships; ^etween variables and factors. This procedure of reloca- 
ting factor,^ (vcctorrO is known as ""rotation*' . This may be done in one 
of two ways. Hither the factors are spe,cified to be uncor related , in 
which car.e the vectors remain at right angles to each other ao they are 
rotated. Or tlie facrors can th(^m^,elves be intercorrelated . In^this 
cnse, the .-inr.le belwc/Mi the vectors is not consitrained to be ninety 
(k-.f;ree.o. The fnrtor niatrices wliieh result frow rotation are sairj to be 
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orthogonal if the factors are uncorrelated , and oblique if the factors 
are correlated. 

^ In Simplifying and 'describing intercororelation datd, factor > ^ 

.analysis gives us several kinds af information either directly stated 
ia, or which can be derived from, factor matrices. These statistics arenas 
follows : 

A numb'^^f factors . .The number of factors extracted by factor analysis 
ca>i be specified either by the researcher directly, or indirectly by 
'specylfying values of other statistics, such as the minimum eigenvalue 
to be accepted for a factor, the accuracy of the factor solution, and 
so on. For reasons, that will become apparent^ it is often more meaningful 
for the Researcher to specif^y the number of factors to be extracted ^\ 
indirectly rather than , directly , since differencep in the number of 
factors needed to describe interrelationships between a set of variables 
■■ f 

are theSmlves of interest. 

Factor patterns . Factors are described and named in terms of Xhe 
- variables that load highly on them. In a matrix, a pattern of high 

loadings isVpparent which describes thh^ructure of the intercorrelations 
between f^S^ors and variable,^. 

Factor loadlnRS. These are the Individual values of the relationships 
between each variable * and^ each factor. » ^ 

Common factor variance . Also known as the communality of each variable, 
thin statistic (the sum of the squared loadings) Indicates how much of 
the varlarico; of oach variable can be accounted for b'y the factor loadings. 

.../5 
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Sometimes this is discussed in t^ms of the variance .not accounted for 
by thk factors - unis^ue factor variance ~ which is quite simply the^ 
communa^ity subtracted from one. - , 

Interfactor correlatldns. ' These are Uadication? of the interrelationships 
.between the factors themselves. They are either zero', for orthogonal 
solutions, or non^zerafor oblique solutions. 

These five statistics^ provide interesting afeB€rrd^XiS!}.?.,°^ 
structural properties of sets of sets of interrelated variables. 
However, purely descriptive information is of little use to statistically- 
based research. Factor matrices can describe structures very ^ell,^but 
have not been able to say if one structure is significantly different 
from another; at least, not until recently. Thanks largely to the 
development of computers, it is now possible to perfonA the immensely 
lengthy and complicated computations which are needed- to use factor 
analysis for hypothesis testing, ' Ni^ 

Hypothesis testinj^ with factor analysife. • ^ 
* Conf irm^itory factor analysis, described, by Mulaik (1972, pp. 361-^ 

401), allows the Ir&searcher to'4:est|the stru'ctiltre of a set of intercor- 

i ' 

related variables 'against a pre-determined modi^l of factor structure. 
A researcher can state an hypo ttfcsis concerning the structure of the 
interrelationships in question, and can convert this' hypothesis into a 
factor model by assigning predetermined values to some, or to all of the 
five statistics that factpr analysis provides. For example,, he may 
hypothpsize that, within a set of interrelated variables, there are 
three basic factors, with loadings of , certain values in certain positions 



0- / . . , • . - page 6 

with acertain proportion of the common variance accounted for the 
three' facttrrs, which ^e themselves interrelated in a certain way; The 
techniques of confirmatory factor analysis allow him to test the actual 
obse^rved data against the hypothetical mojclel, and to estimate the' goodness 
o'f the fit of the model to the data. -The goodness of fit is indicated 
By a large-sampie ahi-square value. If the chi-square value is 
significant, then it is probable that there is not a gpod fit between the 
datd and the model, and the hypothesis should be rejected. "A non- 
significant chi-square indicates a £ood fit, -and the researcher should 
conclude that any appa-rent deviatiorns of the data from the model are 
due to cha|ice,-and that the hypothetical model provides an adequate 
descriptiop of the structure of the data. 

^ /■ 

A further refinement of confirmatory factor analysis is 

simultaneous factor analysfa (Joreskog, 1971). With this procedure,' 

confirmatory factor analysia^an be -perfDnned ciq^more than one population 

at once. Althoagh this method was developed^ tdi identify factorf models 

common to two or more populations by 'estimating tftte goodness Isf fit , to 

both simultaneously, with care the technique can be) used to test for 

.differences in the structure of interrelationships among identical sets 

of variables in two or more populations. First, the researcher facto 

analyzes the intercorrelation matrix of variables in one of the 

popplations. He takes the values obtainpd for each of the f ive/statis- ' 

• • _ / 

tics as his hypothetical model, and then factor analyzes botl/populationp 

simultaneously. A significant chi-aquare indicates a significant 
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departure of the second population from the model based on the fitst 
population, and the researcher can conclude that the interrelationships 
among the variables are different in the two populations.' 

Joreskog offers a furt|her refinement to his method. By starting 
out with -a general factor model, and gradually making it more specific, 
it is possible not only • to discover whether the two sets of dafta are 
structurally different, but also to isolate t\\at particular staMstic in 
which th^ difference occurs. This is helped considerably by the. , 
hierarchical nature of the statistics. , For example, differences in factor 
"loadings do nor necessarily imply differences in factor pattern, but will 
always imply differences in conunon factor .variance . The researcher begins 
by testing the most general model which states that the number of factors 
is irivariant. ylle then tests the more restricted model of the invariance 
of factor pattern, then common factor variance, then interfactor 
correlation. If he finds that the factor patterns are the spme for both 
populations, but then that commin factor variances are different, he can 
conclude that the number of factors, and factor patterns are the same in 
both populations, but that common factor variance' and interfactor cor- 
relations are different. Each suc'cessive hypothetical model is a 
specific instance of the preceding one. 

Trends in Educational Techno loKV Research . 

The descent from the rarified * atmosphere of factor analysis 
theory to the do^^^^^-e&rth problems of instructional technology 'research 
is not as precipitous as it might at. first seem. .Recent pleasby,. 
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resea^hers have suggested that TesearJfh become more r"epi:e.sentat ive of 
reaf-wo»ld situations. Stowe (1973) Suggests both' the systems approach 
and research as methpdologies for education. While the latter would 
not be Superceded by (the former, -the systems approach would nevertheless^ 
broaden the scope of the educational researcher- A systems approach to 
reaearchable ^problems would mean conducting. research in the classroom 
ratH^^r t^h^n in the laboratory ^^^ariables' of ten excluded by experimental 
control wdul^Tbe included in ani^ysis, perhaps- at the expense of 
statistic^ precision and high levels of significance. Research designs 

would become mifre representative' of classroom environments and would . 

• • <i' * • 

allow proximal and distal/var iables to enter into research designs and 

/ . . ^ ./^ 

analysis (Sno^ 197^0- Indeed, Clark and Snow (1975) have p^opbsed 

> ' \ - ' ^-^ 

researcfh designs that allow for experimental control withgut limiting ^ 

representatliieness, that have both internal and ."ecological^' ^lid Jty . 

It isViot difficult to see why these more representative and 

realistic research methodologies are so appropriate tc? educal^lonal 

technology research. The educational technologist is concerned 

anc^ foremost with systems, whether of media, machines and resources^ 

teachers, facilities and fi^udeats, or complex interrelationships of 

lc{lrner characteristics. The study of systems-'of any type requires 

the acknowledgement of complexity. If, in a system/ a part is isolated 

from the other parts, the" system breaks down. Educational technology 

researchers- cannot therefore /afford to look at things in. isolation", 

,but_mu«/t, as Snow says, loOlfc at peripheral vnrialjles as well: The . 

integration c^^earninp, r<380urces into optimum learning cnvtronmeRts 

*^ , . 
.../9 
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requires "a holistic approach to research and^development 

. Similarly," i"f, complex learning environments are to be exploited 
to'their fullest witb learners , ^the learners themselves m'ust treated 
holistically' as well. Winn (1975) drew attention to the 

fa«t that the learner^ is a^ complex system of niany interrelated variables. - 
TO the learning situation, the learner brings not merely prior learnings 
but feelings, unrelated associations, opinions, attitudes and so on. 
It seemed appropriate to Winn to coaf^^er the learner as f ijl^^ioning' 
cognitively in a w^y analogous ^o an open system. A model of learning, 
built aroupd^this anWogy, allows for the effect of peripheral environ- 
mental variables upon the more central variables of learning. ■ V ^ 

One common thtead underlies Ull of these suggestions and analogies., 
If ^educational technologists want to study the effi^ts of richly varied 
learning environments on the whole learner, tl;ien.they must take' into 
•consideration wjj^e systems of variables both within and -outpide the ^ 
learner.. Aptitude-treatment interaction research is a siflh that 
rcsiarchers recognize that learners differ on many dimenj/ions, anfl the 
technique has produced many interesting findings, which /are alteady 
giving n^-to some useful generalizations (Allen, 19756. Howeyer, in a 
truly ropresefitative learning Dituat ion , . eifen assigning small groups of 
.students -to jJiffcrcAt instructional treatments on 'the basis of 'defined 
and reslaro^ed aptitudes is not real-ly going far Snough. Really, each 
variable affcSpting e^ch learner as an individual should be accounted for. 
Obviously, th'i^ is logistically impossible at present. Howevp^, the • 
educational t^^chnologlst^an begin moving in this -direction if ^e' studies 
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many variables in single subjects rather Chan just a few variables in 
many subjects- 

The study of many- variables in. combination in learners "has two 

implications: the researcher needs to obtain daja on the learner's 

cognitive structure rathei: than just performances; such* ^ructural infor- 

mationj, because it involves many variables, must be analyzed by*multi- * 

variate techniques. Moreover, the researcher^ needs Co be able to user 

multivariate techniques to test statistical hypotheses about ^iffetences 

itween various structures, and changes in them. Among the several 

^ i * 
a^5^a)ble multivariate techniques, factor analysis provides the nec^essary 

tructural information, and in its confirmatory and simultaneous forms 

ia capable of testing hypotheses about; these structures and differences 

etween them. Deese's studies of the structureof assbciative meaning 

(Deese, 1962, 1965) are good 'Examples of how factor analysis c^n describe 

structural relationships between concepts.. The factor matrices^m'erging 

Jrom the analysis of intersection coefficients derived from frGt> ^ 

associations to groups of related words proviifed detailed descriptions 

of the way the concepts named ^y the word^ werp related. Deese's 

technique, mo(}i£ied to suit the more recent developments in confirmatory 

and simultaneous factor analysis, provides ayery useful jumping-dff point 

for the study of cognitive structure. In some Instancos, confirmation 

of the results obtained from factor analysis is possible through^>a<rfysls 

of variance and multiple regression tecl?Tniques . This confirmation is ^ , 
C 

useful to validate factor analysis as a mei^iod of testing hypotheses. 

..../II 
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F^tor analysis and cognitive structure ^ ^ . , ^ * , 

, Factis^ analysis can only provide meaningf i>l , data to the ^researcher 
if he\has some idea of what it is in human* cognition that ^the various 
statisCjiQS derived from factbr analysis represents It Is intuitively 
. 'appealing to suppose that, since faptor analysis provides information 



-about, str^uctural interrelationstiips between variables, factor'" matrices 
represent ^cognitive structure in some way* ^If this wete so, then the 
fesearcheri could l^ndeed, test ^ hypo theses about changes- in the way in 
vhich subjects structure the information they receive, hot just the way 

^ they perfo|rm on tests. Cognitive structure itself would thea bqpome a 

• dependent variable. But for this come about; the researcher must' be 

able to answer such questjdons as', ""Wliat is <a factor?'^ "What do significant 
dif ferencesj in common factor variance mean in terms of- how a subjecft 

' ■ , . . ./ v_ , .1^- , 

• struQ^tures information?^* ^^Fortunately , answers to some of these questions ^ 
can be found in the literature, 

,3cott (1966) suggests that^the number of factors extracted by 
factor analysis under certain specified procedures serves as a s^atis- 
factory measure of domain /iiff^entiation. This is a property 6f • 
cognitive structure which indicates the degree to which a person distin- 
guishes among the elements in a given cognitive damain. For example, if 

\ ' . ' ^ ^ 

.one subject' arranges .object^ in a given domain in such a way that, five 

■ ^? , ■ ^ ■ 

factors are ex^acted f rom^ the* intercorrelations between?' the objects, the 
researcheBvcan conclude that this subjdct has a more complex dijcfeir^tia- 

i^ti'g sti^ucture. than a subject ^or whom nnly four "factors are obtained! 

• >. * 

A more elaborate picture of cognitive s,tructure is offered by 
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MacNeill (197A). Like Scott's report, MacNeill/s paper also offers ^ 
possibilities for relating factor matrices to cognitive structure. 

\ • ' : 

MacNeill identifies \two main components of cogi>itive structure: discrimi- 

I « •« ♦ 

natine structu^, which refers to the breaking-down of information into 
its components for^ sorting; and integrating structure, which refers to 
how thfe partitioned p^rts.are related. .(It is impossible to overlook 
the parallel, between discriminating 'and integrating structures, and 
Piaget's "assimilatiorv" and "aocomfhodation", (Piagfet, 1967). The 
complexity of a person's cognitive structure ' depends upon the complexity ^ . 
of both the discriminating and the; ^integrating components. Discriminative 
complexity is a function of the number of dimensions in a person's cognitive 
structure and of the articulation .of those dimensiorrs. J.t a -dimensiori is 
cons-^dered to be iike a scale on which people rate items then 'the 
articulation of the dimension is a function of the number of possible 
gradations on the dimension. Intsegrative cognitive complexity is a 
function of the relationships t|etween>tKe dimensions. A person's v 
discriminative complexity increases as the number of dimensions and the 
number of gradations on them increases, and integrative complexity ^e; ^ 
increases as the dimensions become less correlated to each other. 

•Parallels between this conception of cognitive structure and 
factor matrix statistics are easily s'feen. Again, it is intuitively 
appealing to think ^f factors derived from the interrelationships between 
concepts to represent the dimensions of cognitive structure, factor 
loadings to be related to articulation,, and interf actor correlations to 
describe degrees of integrative cognitive complexity. If the relationship 

' . ' ..../13 
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between factor patterns and cognitive structure could be proven to exist 
in fact, this would be most useful to educational technology researchers. 
It would allow them to s£udy the impact of «iultiyariat-e learning 
env,ironmenrs 6n the cognitive structure of individual learners and of 
•groups of learners, and arrive not just at asses&nients of tht^ ef f ectivetless 
of dlnstruction on learner performance, but al'so on how the learners 
structure the information in the first place. 



Experimeiital evidence. 



Two studies have just been completed which attempt to ^^elate 
the vs^^rious statistics provided by a factor matrix to^ cognitive structure 
and learning, (Winn, 1976a, 1976b). Beginning from Shavelson's (1972) 
s'tudy showing that instruction leads to betn:er-def ined cognitive^ 
structures, a first' etudy^ set out to compare factor matrices obtained 
from int«^rrelated concepts 'obtained before and after instruction in that 
domain from which the concepts ' were taken. If factor analysis can indeed ' 
reveal cognitive structure, then, according to the theory of cognitive 
complexity, factor matrices should reflect changes in complexity as a 
resuK^ instruction* More specifically, instruction should bring about^ 
an increase in the number of factors, and an increase in^t-he loadings 
•matched by an increase in common factor variance as a result of increased 
discriminative complexity, and it should also bring about a decrease in 
interf actor correlations as a result of increased integrative complexity. 

- These hypotheses were tested as follows: Subjects were pretestecf 
in semantics at the beginning of 'an introductory coffununications course. 

... J 

f ^ I 
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At the^same time, they made single free verbal associations to twelve 
words naming key concepts in the semantic area» These associats^ionS* 

r • 

.were used to compute intersection coefficients measuring the association 

between the concepts, and these coefficients were factor-analyzed. This 

procedure replicated exactly Deese's (1962, 1965) method of studying 

associative meaning. After the three weeks normal course-work, which 

•< 

comprised the "semantics unit'Vin the course, the subjects were post- 

1 . - , f 

tested on s^tnantics and made a second set of free associations to the 
same words. These too were factor analyzed. Pre-and post^-test comparisons 
of the test scores shoWed that the subjects had learned a significant , 
amount about semantics. ^ 

s 

9 The two factor matrices derived from the associations made before 
a¥id after instvruptlon were compared using Jbreskog's simultaneous factor 
analysis of severa^l populations ^racedure, described earlier in this 
paper. Although no significant diffexences were found between the number 
of factors and the* factor -pattern's of the two matrices; the matrix obtained 
^from 'the post-instruction associations had significantly larger common 
factor variances and significantly smaller interf actor correlations. 
These two 'significant differiences lend credence to cogniti^ve contplexity ^ 
theory, and also to the ability of factor analysis to reveal cognitive 
structure. The lack^ of differences between the two matrices as far as 
the number of factors and factor patterns were jconcerned was not 
surprising in view of the generally low factor loadings, in both matrices. 
The unique factor variances were much larger than the common factor ^ 
variances in botH matrices, and this means that the factors that were 

- ^6 
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extflracted accdunted for only a s.mall "portion of the total variance. This 
phenomenon is ^Iso true in Deese's work, incidentally, and is probably ^ 
attributable to the low probability of similar associations being made 
to different words, even If the words aVe judged to be highly related 
conceptually. It seems, however ,, that tlat amount of variance accounted 
for' by factors, and interf actor correlatidns , are" related to learning, 
and one can conclude, perhaps, that learning\brings about cognitive 
structures of greater integrative complexity aW greater "structuredness". . 

A second study was conducted lo explore' further the relationships 
between factor -stjructure as ' a measure of cognitive structure and 
performance.' In this second study two measures of performance were. used. 
The first of these, a^' in' the previcJus sttidy, was the subject's score^ 
on a^.written test. The sUond performance measure was the mean number 
- of word associatioi^s each subject gave to the stimulus ^words-.. This second , 

measure was chosen as a dependent variable because it v^as' seen as an 
yndication of a subject's familiarity with aiwi. access to the content and 

not necessarily 'the accuracy nit^i which he knew it. 

\ . • ■ . 

After normal classroom instrucbio^j in audiovisual communication, 
which was the next segment in the introductory communications course used 
in thJ- first study, students made Multiple free associations to ten words 
naming ten new k^y concepts, this was a modification of.Deesers procedure 
developed by Winn (1976c)- in another study. At the same tiV. the subjects 
took their midterm exan^ Their performance on those questions directly 
related to the ten key /ords was noted,' as was the mean number of words < 

:.../i6 
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each subject gave as associations to the stimulus words. Intersection 
coefficients for the ten stimulus words were calculated for each subject, 
and these were factor analyzed. In this way, factor matrices were 
obtained for every individual subject. The number of -factors , the mean 
common factor variance, the percentage of variance accounted for by the 
first factor, and the.' pero^ntage of variance accounted for by all of the 
factors were noted from the factor matrices of each subject. These- 

^statistics were then used as predictors of midterm test performance and 
of the mean number of associat;ions made by each subject. Multiple 
f^ession of these variables on midterm score and number of associations 
showed a significant positive relationship between mean" common factor 

♦ variance and midterm score,- and between all of. the predictor variables 
and number of associations made . *A significance ,level_of .059 was also 
obtained for the relationship between midterm score and the percentage of 
variance accounted ■ for by the first factor, \ 

' • V 

^"X^" This second study provides further evidence of the xMationship 
between cognitive structure measured by factor analysis ahd performance. 
The relationship between cgmmon factor -variance -and perfo_rmance on the 
midterm test was not unexpected, anl* serves to support the similar 51ndini 
in the 'first study. The near-significance of the relationship between 

• 1 

the midterm score and the percentage of variance accounted for by the 

K , 

first; factor alone requires further experimental study. This is all the 
more neacssary since the relationship between the percentage of variance 
accounted for by all the factors and midterm score was no where near 

A 

significant. This sjugRests that there is quite a complex -relationship 
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between performance on the test and the cumulative variance accounted for 

I 

4 • 

by successive factors. An interact ion 5ef feet between performance and^ 

cumulative percentage might well exist. ^ • • 

• ♦ 

Th^ significant negative correlation between mean ifpinber of 
associations given to the stimulus words and the number of factors seem 
to contradict cognitive complexity theory. The more assoc:|.ations a. 
"subject makes to a set of interrelated words, the fewer thV number of ^ 
factors which acco'unt for the^common meaning. If factors correspond to 
dimensions in cognitive structure, the Opposite should occu^. There ar^e 
two points that need to be made. The first concerns the idea that .tl^e 
more associations that are made, ^he more overlkp there must be.^ While it 
is true that 'the probability of repetition increases as t^he-*' number of 
responses increases, it is also true ' that the number of uni|i^ responses 
increases ^s well. It seems unlikely, therefore, that 'the ifepe|^ition 
of certain responses account^ for the smaller number of factors. A moi?e ^ 
plausible explanation seems to be that fluency of associatign is somehow 
related to simplicity of associative structure. In this ca3e', tho$ie 
subjects wl^o are able to structure a cognitive domain with ^;he help of 
just a few dimensions would be able to give ttore associations to key 
words from that domain.- Access to the various dimensions of the domiiin 
' would be easier for them. Simplicity of cognitive structure leacis to 
greater familiarity with the content of that structure. However, this 
simplicity does not seem to help performance on a test based on the 
content.' There was no significant relationship between the number o£ 
factors and perf oi!-mance on .the midterm test. Neither, -incidentally, 
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•'were the * two dependent variables, test performance and number of , ^ 

(• 

associations, significantly related. ^ f 

A signiW-cant positive relationship between common factor variance 
and 'the numberv of associations ma^de should cause no surprise. It confirms, 
for' number of associations as a measure of subject ..erformance, what the ^ 
first, study and the other part oj/ this study showed for test performance. 
The^ more associat ions> that are^made, the more the variance can be 
accounted for by the common factors. 

The relationships between 'the percentages of variance accounted 
for by the factors and bhe-mean number of associations for each stimulus ^ 
"^word seem to be as complex as the relationships between these percentages 
and midterm test performance. There was a significant negative 
relationship ^between the total p^centage of variance accounted for by^^the 
factors and^the number of associations made , and > significant positive ^ 
relationship between the percentage^of variance accounted for ^by the 
-first factor and the^number of asaeciktions made. .The intei*ction between; ^ 
. factor position, amount of variance accounted for by the factor and number 
of wordfigfven a9 associations is difficult Vo interpret without further • 
study. However, the greater the number of words, the ^greater the 
percentage of variance accounted £or' by the first factor, and the smaller 
the percentage of var.lance acccmated for ty all the "factors. ' It seems 
. " that cognitive .simplicity is accompanied by a markedly unequal distribution 
of the cominon factot variahce among the factors. As subjects maJce more 



responses, they not" only use fewer dimensions to structure the cognitive 
domain ip question, but , the importance of, the most important, dimension 
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is much greater than that of the others. " . ' 

The results of these two. studies can be generallzec^ only with 

caution. It* seems that common facftor variance\^ a good i^dicatjor of 

performance on a written test of a cognitive domain. The more A person 

knows about something, the more the common meaMng of the Concepts withl^ 

■ - *^ . 

the domain cati be 'accounted for by th^f undamental dimensions al<?a& which ' 

the person structures his knowledge of the domain. Beyond jthis, the- 

amount of variance accounted for by the most ^important of these- dimensions. 

also seems to be a' good predictor of test performance, though the reasons 

for- this can only be speculative with the amount of data, f utnisheA by 

these. two. studies. There appear to be stronger relationships between 

the number Of associations given and cognitive structure.-. Simplicity oi 

structure seems to fenable the learner to make associations more ea'6ily» ■ 

and suggests an easier access to the information in his cognitive ^ 

structure. Common factor variance, too, is closely -related to the number 

of asscrciations given, and there also appears to be a relationship ; 

though a complex one, between the order of factors, the amount of variance 

they contribute, and tfie number of words jgiven as associations. I 

Generally, the various statistics given by factor analysis seem t6 behave 

as cognitive complexity theory predicts 'they should, although there,^ 

" appears to be a stronger relationship between these statistics and « 

quantitative measures, such as the number of associations maa^, than 

quantitative measures, such as test performance. 

It appears tlTen that factor analysis is capable of describing | 

certain aspects of cognitive structure. Just where does it fit into 
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earch in educational technology? obvious advantage thaV- th^ 



technique has oyer other more traditional methods of -data 'analysis 'is 
that factor analysis permits the researcher tp assess the impact of ./ ^ 
various instructional' treatments on how learners procesp. and structure 
informa.tion. not just on how they perform on t^sts'^f that infomation. 
If -the values attached to the various statistics^derived from factor 
analysis are used as dependent variables in a research study, then^the- 
researcher w±ll be able to observe structural changes in the leatn^^ as 
a result of ' various instructional treatments'. These structural changes, 
moreover, will be attributable tXhe action^f 'many variables . notii just. • 
a few, if free association data are used. 

, An example of the us7 of factoi analysis in this way^ is • a study ; 
,by Winn (1976c) of th^. strvj:tural deferences in free associations to. _ 

words. black-ai,d-wkite and color pictures. Sub j-ects made multiple ;^ee 
. associations -to mono chW. and to color pictures . and to the corre^pVding 
noun labels. The .intersection coefficients between the sets of stimuli 
were factor analyzed . vand the three matrices -^.ere cotnpared using Joreskog's 
technique. It was fc/und that the common factor variances of. both mono- 
clirome and cqlor pic/tures differed from those of the nouns, but^tha^t the 
factor patterns wer6 the same. It was concluded that. the basic cognitive " 
structures derived from pictures and words are the same, but that words 
lead to a tighter structuring of information than pictures. The shapes 
of the structures are the same for bpth words and pictures, but the 
shapes and mJre clearly defined "in the case of words. These results 
allowed the researcher to draw conclusions about^ differences between the 
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'qualitative and" the quantitative effects of different ways of presenting 



Informat^n. Facto'r analysis provided information about the qualitative 
aspects . of thfe -structures which would not have been available as a result 
of more traditional forms of analysis, 

A second experiment in the same study allo\^ Winn to isolate two 
color factors in the* analysis of associations to colored stimuli. This 
showed that color does indeed have an effect on the way iri which ^learners 
structure infor]pgit ion , when color is used to differentiate concepts witj/hi^i 
a conceptual domain. Here again, factor analysis in the confirmatory \^ 
mode allowed structural information to be studied where more conventional 
techniques would not have proven adequate,- 
t Clearly, these few studies are primitivje. The complex techniques 

/associated with the use o( factor analysis in these and similar 
' experimental settings have to be refJ^ned to some extent. However, the 
analysis of^frec associations by the various techniques discussed above 
does provide an "access route" to cognitive structure. There is a need 
for researchers in the educational tcchnalogy area to apply these techni- 
ques to the study of the effectiveness of differettt instructional 
treatments on ^dif'f erent learners. We need information about the learner- 
as-system, and factor analyoif* Xan give it to us. Nor should the 
researcher limit himself to the analysis of free associations. Dec^se's 
technique has limitations, Jt iB hard Lo imagine that freely associating., 
to stimuli allows the subject to *reveal everything he knows and feels about 
something. Other methods of de^rj^ing profiles of the, structure of a 
particular cognitive domain nomj to be developed. Digraph analysis of 
instructional content (Frase, 1969; Kingsley, Kopstein and Seidel, 1968) 
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ancl adjacency matrix, construction (Harary, Norman and Cartwright , ^ 1965) 
both offer to 'extend the intercorrelaticjn of concepts in a given domain 
away from, single-word responses towards connected discourse. Other types , 
of factor analysis need to be expfored^as well. Particularly promising 
is longitudinal factor analysis (Evans. 1967) as a .technique for comparing ^ 
structures in a "before and after" experimental design. Other milltiva- ^ 
riate techniques shotild not be overlooked either. An Example of multiple^ 
regression, used in conjunction with factor analyses has already bein 
given. Us usefulness to the educational technology reaearcher is not • . 
bo be underestimated. 

; In conclusion, factor analysis is useful to the educational 
technology researcher ch*«=£J.y because it provides qualitative information 
about -a learrxpr's cognitive structure. Recent developments in the 
techaikiue allow it to be used for hypothesis testing and for the comparison 

f ■ 

or structures derived from different treatments, and derived before and 
9fter treatments. In this way it is particularly' useful for telling us 
about- the way learners process and arrange the information fhey receive , 
without excluding any of the peripheral variables that inevitably 
influence cognition. Experiments have shown that the various s^tistics 
derived from factor analysis of fr'ee association data do indeed act as . 
prcdtcators of some kinds o£ learner performance, and, by following the 
predictions of -cognitive complexity theory, the:^ have been shox^n to provide 
fnformation about the learner's cognitive structure. Clearly,- the 
experiments reported above heed to be replicated. It is far too early 
to place great con^'idencc in the validity of factor analysis as a measure 
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of co'gnltlve structure. Bufr what has teen done 'So far suggests that 
this is an area. worthy of further study, artd that , applied to the 
■study differences in cognitive structures derived from different 
instructional treatments, factor analysis is indeed capable of becoming 
one of. the educational technologist's most valuable research tools. 
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